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DETAILED ACTION 
Claims Rejections - 35 USC § 103 

1 . The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

2. Claims 1, 9 and 10 are rejected under 35 U.S.C. 103(a) as being unpatentable over Choi 
et al (US Patent No.: 6,21 1,856) in view of Cooper et al. (US Patent No.: 6,509,892). 

As to claim 1, Choi discloses a control panel for a device, comprising: 
a graphical user interface (GUI) displaying a plurality of control icons (Example, GUI touch 
screen display on a hand-held device that provides a maximum number of icons on the display 
yet the features of the icons are easily accessible by a user, see, Col., 1 lines, 52-56) 

wherein the plurality of control icons represent a plurality of corresponding control 
functions for controlling the device (example, The devices include a display for displaying a 
GUI, and a controller for enabling a user to control the system through a touch screen 
functionality of the GUI, see, col., 1 lines, 15-18) 

and means for providing tactile detect ability to said GUI to allow a user to detect at least 
one of the pluralities of control icons by touch (example, the individual keys surrounding area 14 
are magnified and large enough for easy touch screen activation of a single key by a finger, col. 2 
lines, 63-66 and Figure lb). 

However Choi does not specifically disclose means for providing tactile detectability. 
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Cooper from the same field of endeavor discloses means for providing tactile 
detectability (example, tactile detectability, see Abstract). 

It would have been obvious to have modified Choi's GUI touch screen device at the time 
of the invention with tactile detectability as presented by Cooper. The motivation to combine a 
control surface that is flexible is enabled to provide a tactile-detectable graphical representation 
of graphical output from a data processing system. 

As to claim 9 , Choi discloses further wherein said GUI displays a plurality of user- 
selectable and user controllable functionalities distributed over multiple display interfaces in a 
control hierarchy of a system (see Figure 2a). 

As to claim 10 , Choi discloses wherein said system is a consumer electronics system (see 
col., 3 lines, 24-26). 

3. Claims 2, 4, 5, 6, 7 and 1 1 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Choi et al (US Patent No.: 6,21 1,856) in view of Cooper et al. (US Patent No.: 6,509,892) and 
further in view of Rosenberg (US Patent No.: 6429846). 

As to clam 2 . Choi in view of Cooper does not disclose wherein said means for 
providing tactile detectability provides at least one surface vibration to said GUI. 

Rosenberg from the same field of endeavor discloses wherein said means for 
providing tactile detectability provides at least one surface vibration to said GUI (col., 5 lines, 
59-66). 

It would have been obvious to have modified the modified Choi's GUI touch screen 
device at the time of the invention with tactile sensations as presented by Rosenberg. 
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The motivation to combine to provide haptic feedback to the user in order that the user of 
a touchpad is therefore able to experience haptic sensations that assist and inform the user of 
targeting and other control tasks within the graphical environment. 

As to claim 4 . Rosenberg discloses wherein at least two of the plurality of control icons 
has different surface vibrations (see col., 5 lines, 65-67 and col., 6 lines, 1-4). 

As to claim 5 , Rosenberg disclose wherein said at least one surface vibration is present on 
at least one control icon of said plurality of control icons and not present on a surrounding area 
of display (see col., 15 lines, 12-23). 

As to claim 6 . Choi does not disclose wherein said at least one surface vibration is 
present on an area of display surrounding said plurality of control icons and not present on said 
plurality of control icons. 

Rosenberg from the same field of endeavor disclose wherein said at least one surface 
vibration is present on an area of display surrounding said plurality of control icons and not 
present on said plurality of control icons (col., 15 lines 19-23). 

It would have been obvious to have modified the modified Choi's GUI touch screen 
device the time of the invention with surface vibration as presented by Rosenberg. 

The motivation to combine to provide the touch input device could include multiple 
different regions where at least one of the regions provides the position signal and at least one 
other region provides a signal that is used by the computer to control a different function. 

As to claim7 . Choi does not disclose wherein said at least one surface vibration is present 
on all of said control icons of the plurality of control icons and not present on a surrounding area 
of display. 
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Rosenberg from the same field of endeavor disclose wherein said at least one surface 
vibration is present on all of said control icons of the plurality of control icons and not present on 
a surrounding area of display (col., 15 lines 19-23). 

It would have been obvious to have modified the modified Choi's GUI touch screen 
device the time of the invention with surface vibration as presented by Rosenberg. 

The motivation to combine to provide the touch input device include multiple different 
regions where at least one of the regions provides the position signal and at least one other region 
provides a signal that is used by the computer to control a different function. 

As to claim U , Choi does not disclose wherein a surface vibration of the at least one 
surface vibration is provided to said GUI when the user is transitioning between the multiple 
display interfaces of the control hierarchy. 

Rosenberg from the same field of endeavor disclose wherein a surface vibration of the at 
least one surface vibration is provided to said GUI when the user is transitioning between the 
multiple display interfaces of the control hierarchy (see col. 8, lines, 1-9). 

It would have been obvious to have modified the modified Choi's GUI touch screen 
device the time of the invention with surface vibration as presented by Rosenberg. 

The motivation to combine to provide the haptic sensations output on the touch control 
enhance interactions and manipulations in a displayed graphical environment or when 
controlling an electronic device. 

4. Claim 3 is rejected under 35 U.S.C. 103(a) as being unpatentable over Choi et al (US 
Patent No.: 6,21 1,856) in view of Cooper et al. (US Patent No.: 6,509,892) and further in view of 
Rosenberg (US Patent No.: 6429846) and Massimino (US Patent No.: 5,619,180). 
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As to claim 3 . the modified Choi does not disclose wherein said at least one surface 
vibration is in a range of about 10Hz to about 1 kHz. 

Massimino from the same field of endeavor disclose wherein said at least 
one surface vibration is in a range of about 10Hz to about 1 kHz (see col., 10 lines, 5-10). 

It would have been obvious to have modified the modified Choi's GUI touch screen 
device the time of the invention with frequency of vibration on the order of 1,000 Hz as 
presented by Massimino. 

The motivation to combine to provide a non-visual, non-reactive sensory substitution 
force feedback signal for use in connection with remote effectors applications, which does not 
overload the capabilities of the operator and which remains stable even in the presence of time 
delays. 

5. Claim 8 is rejected under 35 U.S.C. 103(a) as being unpatentable over Choi et al (US 
Patent No.: 6,21 1,856) in view of Cooper et al. (US Patent No.: 6,509,892) and further in view of 
Ling et al. (US Pub No.: 2003/0227374). 

As to claim 8 , Choi in view of Cooper does not disclose wherein said means for 
providing tactile detectability provides electrotactile stimulation to said GUI. 

Ling from the same field of endeavor disclose wherein said means for 
providing tactile detectability provides electrotactile stimulation to said GUI (see abstract). 

It would have been obvious to have modified the modified Choi's GUI touch screen 
device the time of the invention with electrotactile stimulation as presented by Ling. 
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The motivation to combine Electro-Tactile to apply Device electrical energy to the skin 
in order to stimulate the nerve axon of mechanoreceptors, and then generate tactile sensation 
(sense of touch). 

6. Claim 12 is rejected as being unpatentable over Choi et al (US Patent No.: 6,21 1,856) in 
view of Massimino et al. (US Patent No.: 5,619,180) and in further in view of Ling et al. (US 
Pub No.: 2003/0227374). 

As to claim 12 . Choi discloses a method, comprising: providing a control device 
including a display for displaying a graphical user interface (GUI) device (example, The devices 
include a display for displaying a GUI, and a controller for enabling a user to control the system 
through a touch screen functionality of the GUI, see, col., 1 lines, 15-18) 

displaying on the GUI a plurality of control icons representing various control functions 
wherein the control functions enable a user to control a system through the GUI (Example, GUI 
touch screen display on a hand-held device that provides a maximum number of icons on the 
display yet the features of the icons are easily accessible by a user (see, Col., 1 lines, 52-56); 

and adapting at least one of the plurality of control icons so as to be detectable by a user 
via means selected from the group of vibrotactile means, eleetrotactile means, and combinations 
thereof (example, the individual keys surrounding area 14 are magnified and large enough for 
easy touch screen activation of a single key by a finger, col., 2 lines, 63-66 and Figure lb). 

However Choi does not specifically disclose of vibrotactile means. 

Massimino from the same field of endeavor disclose vibrotactile means (see abstract). 
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It would have been obvious to have modified the modified Choi's GUI touch screen 
device the time of the invention with vibroctile stimulation as presented by Massimino. The 
motivation to combine provides force feedback through a sensory substitution display. 

Choi in view of Massimino further does not specifically disclose eleetrotactile means. 

Ling from the same field of endeavor disclose eleetrotactile means (see abstract). 

It would have been obvious to have modified the modified Choi's GUI touch screen 
device the time of the invention with eleetrotactile as presented by Ling. The motivation to 
combine Electro-Tactile to apply Device electrical energy to the skin in order to stimulate the 
nerve axon of mechanoreceptors, and then generate tactile sensation (sense of touch). 
7. Claims 13 and 14 are rejected as being unpatentable over Choi et al (US Patent No.: 
6,21 1,856) in view of Massimino et al. (US Patent No.: 5,619,180) and further in view of Ling et 
al. (US Pub No.: 2003/0227374) as applied to claim 12. 

As to claim 13, the modified Choi does not disclose wherein said vibrotactile means 
include at least one vibration in a range of about 10 Hz to about 1 kHz. 

Massimino from the same field of endeavor disclose wherein said vibrotactile means 
include at least one vibration in a range of about 10 Hz to about 1 kHz (see col., 10 lines, 5-10). 

It would have been obvious to have modified the modified Choi's GUI touch screen 
device the time of the invention with 1,000Hz vibration range as presented by Massimino 

The motivation to combine to provide a non-visual, non-reactive sensory substitution 
force feedback signal for use in connection with remote effectors applications, which does not 
overload the capabilities of the operator and which remains stable even in the presence of time 
delays. 
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As to claim 14 , the modified Choi does not disclose wherein at least two of the plurality 
of control icons has a different vibrotactile characteristic. 

Massimino from the same field of endeavor disclose wherein at least two of the plurality 
of control icons has a different vibrotactile characteristic (see col., 7 lines, 18-24). 

It would have been obvious to have modified the modified Choi's GUI touch screen 
device the time of the invention with vibrational sensitivity in different regions as presented by 
Massimino. 

The motivation to combine to provide a non-visual, non-reactive sensory substitution 
force feedback signal for use in connection with remote effectors applications, which does not 
overload the capabilities of the operator and which remains stable even in the presence of time 
delays. 

8. Claims 15-20 are rejected as being unpatentable over Choi et al (US Patent No.: 
6,211,856) in view of Massimino et al. (US Patent No.: 5,619,180) and in further view of Ling et 
al. (US Pub No.: 2003/0227374) as applied to claim 12 and Rosenberg (US Patent No.: 
6429846). 

As to claim 15 , the modified Choi does not disclose wherein at least one vibrotactile 
characteristic is present on at least one control icon of said plurality of control icons and not 
present on a surrounding area of display. 

Rosenberg from the same field of endeavor disclose wherein said at least 
one vibrotactile characteristic is present on at least one control icon of said plurality of control 
icons and not present on a surrounding area of display (see col., 15 lines, 12-23). 
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It would have been obvious to have modified the modified Choi's GUI touch screen 
device the time of the invention with surface vibration as presented by Rosenberg. 

The motivation to combine to provide the touch input device could include multiple 
different regions where at least one of the regions provides the position signal and at least one 
other region provides a signal that is used by the computer to control a different function. 

The modified Choi does not specifically disclose vibrotactile. 

Massimino from the same field of endeavor disclose vibrotactile (see col., abstract). 

It would have been obvious to have modified the modified Choi's GUI touch screen 
device the time of the invention with vibrotactile as presented by Massimino 

The motivation to combine to provide a non-visual, non-reactive sensory substitution 
force feedback signal for use in connection with remote effectors applications, which does not 
overload the capabilities of the operator and which remains stable even in the presence of time 
delays. 

As to claim 16 , the modified Choi does not disclose wherein at least one vibrotactile 
characteristic is present on an area of display surrounding said plurality of control icons and not 
present on said plurality of control icons. 

Rosenberg from the same field of endeavor disclose wherein said at least vibrotactile 
characteristic is present on an area of display surrounding said plurality of control icons and not 
present on said plurality of control icons (col., 15 lines 19-23). 

It would have been obvious to have modified the modified Choi's GUI touch screen 
device the time of the invention with surface vibration as presented by Rosenberg. 
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The motivation to combine to provide the touch input device include multiple different 
regions where at least one of the regions provides the position signal and at least one other region 
provides a signal that is used by the computer to control a different function. 

The modified Choi further does not specifically disclose vibrotactile. 

Massimino from the same field of endeavor disclose vibrotactile (see col., abstract). 

It would have been obvious to have modified the modified Choi's GUI touch screen 
device the time of the invention with vibrotactile as presented by Massimino 

The motivation to combine to provide a non-visual, non-reactive sensory substitution 
force feedback signal for use in connection with remote effectors applications, which does not 
overload the capabilities of the operator and which remains stable even in the presence of time 
delays. 

As to claim 17 , the modified Choi does not disclose wherein at least one 
vibrotactile characteristic is present on all of said control icons of said plurality of control icons 
and not present on a surrounding area of display. 

Rosenberg from the same field of endeavor disclose wherein said at least one surface 
vibration is present on all of said control icons of the plurality of control icons and not present on 
a surrounding area of display (col., 15 lines 19-23). 

It would have been obvious to have modified the modified Choi's GUI touch screen 
device the time of the invention with surface vibration as presented by Rosenberg. 

The motivation to combine to provide the touch input device include multiple different 
regions where at least one of the regions provides the position signal and at least one other region 
provides a signal that is used by the computer to control a different function. 
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The modified Choi further does not specifically disclose vibrotactile. 

Massimino from the same field of endeavor disclose vibrotactile (see col., abstract). 

It would have been obvious to have modified the modified Choi's GUI touch screen 
device the time of the invention with vibrotactile as presented by Massimino. 

The motivation to combine to provide a non-visual, non-reactive sensory substitution 
force feedback signal for use in connection with remote effectors applications, which does not 
overload the capabilities of the operator and which remains stable even in the presence of time 
delays. 

As to claim 18 , the modified Choi discloses further wherein said GUI displays a plurality 
of user-selectable and user controllable functionalities distributed over multiple display 
interfaces in a control hierarchy of a system (see Figure 2a). 

As to claim 19 , the modified Choi discloses wherein said system is a consumer 
electronics system (see col., 3 lines, 24-26). 

As to claim 20 , the modified Choi does not disclose wherein a surface vibration of the at 
least one surface vibration is provided to said GUI when the user is transitioning between the 
multiple display interfaces of the control hierarchy. 

Rosenberg from the same field of endeavor disclose wherein a surface vibration of the at 
least one surface vibration is provided to said GUI when the user is transitioning between the 
multiple display interfaces of the control hierarchy (see col. 8, lines, 1-9). 

It would have been obvious to have modified the modified Choi's GUI touch screen 
device the time of the invention with surface vibration as presented by Rosenberg. 
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The motivation to combine to provide the haptic sensations output on the touch control 
enhance interactions and manipulations in a displayed graphical environment or when 
controlling an electronic device. 

Conclusion 

9. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

Flowers et al. (US Patent No.: 5038142) is cited to teach Touch sensing display screen 
apparatus. 

Blouin (US Patent No.: 5,977,867) is cited to teach Touch pad panel with tactile 
feedback. 

Shaw et al. (US Patent No.: 7,1 19,789) is cited to teach Haptic interface including clutch 

control. 

Kazlausky et al. (US Pub No.: 2001/0029319) is cited to teach System and method of 
monitoring and modifying human activity-based behavior. 

Tremblay et al. (US Pub No.: 2003/0016207) is cited to teach Tactile feedback man- 
machine interface device. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Meseker Takele whose telephone number is (571) 270-1653. The 
examiner can normally be reached on Monday - Friday 7:30AM- 5:00PM est. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Kristine Kincaid can be reached on (571) 272-4063. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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